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City  and  County  of  San  Francisco 

Office  of  the  Controller  - City  Services  Auditor 


PUBLIC  UTILITIES  COMMISSION:  February  9,  2009 

Continue  Improving  Administration  of  the  Parsons  Water  System  Improvement 
Program  Contract 


Purpose  of  the  Audit 

Following  consultation  with  Public  Utilities  Commission  (PUC)  management,  we  reviewed  the  administration  of 
the  $45  million  contract  between  the  PUC  and  Parsons  Water  and  Infrastructure,  Inc.  (Parsons)  for  program, 
project  and  preconstruction  management  services  for  the  PUC’s  $4.3  billion  Water  System  Improvement 
Program  (WSIP).  We  determined  whether  the  PUC’s  internal  controls  were  sufficient  to  prevent  inappropriate 
payments,  whether  Parsons  complied  with  contract  billing  terms,  and  whether  contractor  billings  were  accurate. 


Highlights 

The  $4.3  billion  WSIP  was  authorized  by  San  Francisco  voters  in  November 

2002,  and  the  PUC  awarded  the  current  contract  to  Parsons  in  May  2005. 

Services  provided  by  Parsons  under  the  contract  include: 

• Program  management,  which  involves  coordinating  and  prioritizing 
resources  across  the  various  WSIP  projects  and  providing  an  infrastructure 
for  successful  management  of  individual  projects  within  the  program. 

• Labor  relations,  construction  planning,  environmental  planning, 
constructability  reviews,  construction  scheduling,  and  development  and 
implementation  of  new  IT  systems. 

• Provision  of  additional  technical  staff  to  increase  the  capacity  of  the  PUC’s 
bureaus  to  support  the  planning,  management  and  construction  of  WSIP 
projects. 

The  audit  found  that: 

• The  PUC  has  significantly  improved  contract  administration  processes 
since  our  last  program  management  contract  audit  was  issued  in  January 
2006. 

• PUC  staff  developed  and  rely  heavily  on  a new  billing  database  to  support 
administration  of  the  Parsons  contract,  but  several  weaknesses  should  be 
addressed  to  improve  database  security,  integrity,  and  usefulness. 

• The  PUC  does  not  use  one  consistent  timekeeping  system  for  the  contract. 
Instead,  it  uses  two  parallel  systems,  which  requires  significant  additional 
work  on  the  part  of  both  PUC  and  Parsons  staff. 

• $21.2  million  (56%)  of  the  $38  million  authorized  during  the  audit  period 
was  for  task  orders  lacking  well-defined  scopes  of  work. 

• The  PUC  permitted  Parsons  to  charge  $16,333  in  markup  on  subcontractor 
expenses  during  the  audit  period,  in  violation  of  contract  terms. 

The  recommendations  made  in  this  report  may  also  be  relevant  to  other 

contracts  for  which  the  PUC  uses,  or  plans  to  use,  similar  contract 

administration  processes. 


Recommendations 

The  audit  report  includes  26 
recommendations  for  the  PUC 
to  enhance  its  contract 
administration  procedures  and 
controls,  better  control  costs, 
and  improve  performance 
management  of  the  Parsons 
contract. 

Specifically,  the  PUC  should: 

• Improve  the  documentation 
of  its  billing  database,  and 
publish  well-defined  roles 
and  responsibilities  for  PUC 
and  Parsons  staff  that  update 
and  use  the  database. 

• Move  to  a single,  unified 
timekeeping  system  for  all 
contract  service  orders, 
rather  than  continuing  to 
operate  two  parallel  systems. 

• Develop  task-level  and 
contract-wide  performance 
measures  and  improve  the 
rigor  of  evaluation  methods 
to  facilitate  more  effective 
monitoring  and  evaluation  of 
contractor  performance. 

• Recoup  $20,276  from  the 
contractor  for  billings  that 
were  inconsistent  with 
contract  terms. 


Copies  of  the  full  report  may  be  obtained  at: 

Controller’s  Office  • City  Hall,  Room  316  • 1 Dr.  Carlton  B.  Good  left  Place  • San  Francisco,  CA  94102  • 415.554.7500 
or  on  the  Internet  at  htto://www.  sfaov.  ora/controller 
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CITY  AND  COUNTY  OF  SAN  FRANCISCO 


OFFICE  OF  THE  CONTROLLER 
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Monique  Zmuda 
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February  9,  2009 

Public  Utilities  Commission 
1155  Market  Street,  1 1th  Floor 
San  Francisco,  CA  94103 

President  and  Members: 

The  Controller's  Office,  City  Services  Auditor,  presents  its  report  on  the  audit  of  the  Public 
Utilities  Commission’s  (PUC)  contract  with  Parsons  Water  and  infrastructure,  Inc.  (Parsons)  for 
the  provision  of  program,  project,  and  preconstruction  services  in  support  of  the  Water  System 
Improvement  Program  (WSIP).  The  audit  objectives  were  to  determine  whether  internal  controls 
over  billing  and  payment  of  invoices  are  sufficient  to  prevent  inappropriate  payments,  and 
whether  Parsons  correctly  billed  the  PUC  in  accordance  with  the  contract’s  terms. 

We  conclude  that  the  PUC’s  WSIP  contract  administration  procedures  have  significantly 
improved  since  our  last  WSIP  program  management  contract  audit  was  issued  in  January  2006; 
however,  additional  improvements  are  needed  in  a number  of  areas.  We  also  found  that 
additional  efforts  are  needed  to  control  costs,  including  better  definition  of  contract  tasks 
performed  by  Parsons  contract  management  and  administration  staff.  Processes  for  measuring 
and  reporting  the  contractor’s  performance  should  also  be  improved  to  properly  manage  the 
contract  and  assess  the  contractor’s  contributions  to  the  WSIP. 

The  audit  includes  26  recommendations  regarding  improvements  to  contract  administration 
procedures,  contract  cost  control,  and  performance  management  of  the  contractor.  The 
recommendations  may  also  be  relevant  to  other  contracts  for  which  the  PUC  uses  or  plans  to 
use  similar  contract  administration  processes. 

The  PUC’s  response  to  the  audit  report  is  attached  as  Appendix  B.  Parsons  chose  not  to  submit 
a response. 

We  appreciate  the  assistance  and  cooperation  that  PUC  and  Parsons  staff  provided  to  us 
during  the  audit. 

Respectfully  submitted, 


Ben  Rosenfield 
Controller 


415-554-7500 


City  Hall  • 1 Dr.  Carlton  B.  Goodlett  Place  • Room  316  • San  Francisco  CA  94102-4694 


FAX  415-554-7466 


cc:  Mayor 

Board  of  Supervisors 
Civil  Grand  Jury 
Budget  Analyst 
Public  Library 
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INTRODUCTION 


Audit  Authority 


Background 


The  PUC  awarded  the 
current  contract  to 
Parsons  in  May  2005 


The  San  Francisco  Charter  provides  the  City  Services 
Auditor  (CSA)  with  broad  authority  to  conduct  audits.  We 
conducted  this  audit  under  that  authority  and  after 
consultations  in  early  2007  with  the  Assistant  General 
Manager,  Infrastructure,  of  the  Public  Utilities  Commission 
(PUC). 

The  PUC  manages  a complex  water  supply  system  that 
includes  reservoirs,  pipelines,  tunnels,  and  treatment 
systems  stretching  from  the  Sierra  to  the  City  and  County  of 
San  Francisco  (City).  One-third  of  the  delivered  water  goes 
to  customers  in  the  City,  while  two-thirds  is  sold  wholesale 
to  suburban  agencies  in  Alameda,  Santa  Clara,  and  San 
Mateo  counties.  Much  of  the  water  system  was  built  in  the 
early  to  mid  1900s,  and  many  of  its  components  are 
nearing  the  end  of  their  useful  lives.  A comprehensive  plan 
for  updating  the  system  was  submitted  for  the  approval  of 
San  Francisco  voters,  and  in  November  2002  they 
authorized  the  $4.3  billion  Water  System  Improvement 
Program  (WSIP)  to  repair,  replace,  and  seismically  upgrade 
components  of  the  system. 

The  City’s  capital  plan  includes  more  spending  for  PUC 
projects  than  for  any  other  department.  The  $4  billion  in 
planned  WSIP  spending  from  July  1, 2007,  through  the 
projected  completion  of  the  program  at  the  end  of  2014, 
represents  approximately  23  percent  of  the  proposed 
capital  spending  included  in  the  City’s  10-year  Capital 
Improvement  Plan  for  2008-201 7.  As  of  the  end  of  2007, 
the  PUC  reported  that  the  regional  program  of  the  WSIP 
was  10  percent  complete  and  the  local  program  was  40 
percent  complete.  The  regional  and  local  programs 
comprise  90  percent  and  10  percent,  respectively,  of  the 
total  WSIP  program.  As  of  April  5,  2008,  the  WSIP  included 
87  individual  projects,  including  34  local  projects  and  53 
projects  that  are  regional  in  scope. 

In  May  2005,  the  PUC  entered  a $38  million  contract  with 
Parsons  Water  & Infrastructure,  Inc.  (Parsons)  for  program, 
project,  and  preconstruction  management  services  in 
support  of  the  WSIP.  The  contract  was  approved  by  the 
Commission  on  May  24,  2005,  and  by  the  Board  of 
Supervisors  on  July  19,  2005.  It  has  a five-year  term  ending 


July  25,  2010. 


Contract  terms;  amounts 
invoiced 


The  contract  states  that  contractor  staff  shall  “work  in  an 
integrated  management  team”  with  the  PUC’s  Infrastructure 
Division,  which  has  primary  responsibility  for  implementing 
the  WSIP.  The  scope  of  work  under  the  contract  includes 
program  management,  which  involves  coordinating  and 
prioritizing  resources  across  the  various  WSIP  projects  and 
providing  an  infrastructure  for  successful  management  of 
individual  projects  within  the  program.  Parsons’  scope  of 
work  also  includes  these  critical  functions: 

• Labor  Relations 

• Construction  Planning 

• Environmental  Planning 

• Constructability  Reviews 

• Construction  Scheduling 

• IT  Systems  Development  and  Integration 

This  is  our  first  audit  of  the  contract  between  Parsons  and 
the  PUC.  The  Office  of  the  Controller  (Controller) 
conducted  a series  of  six  audits  of  a previous  WSIP 
program  management  contract  with  Water  Infrastructure 
Partners  (WIP).1  The  firms  that  composed  WIP  included 
Jacobs  Civil,  Inc.,  Primus  Infrastructure,  LLC,  and  the 
Jefferson  Company. 

Work  under  the  Parsons  contract  is  authorized  by  individual 
task  orders,  each  of  whose  scope,  subtasks,  staffing  plan, 
schedule,  deliverables,  budget,  and  cost  are  established 
separately.  No  work  may  begin  on  a task  order  without  a 
discrete  Notice  to  Proceed  (NTP),  which  is  issued  only  after 
the  availability  of  funds  is  certified  by  the  Controller.  The 
agreement  states  that  evaluations  of  each  task  order  shall 
be  completed  both  quarterly  and  annually. 

The  contract  stipulates  that  task  orders  shall  be  overseen 
by  the  manager  of  one  of  the  PUC’s  Infrastructure  bureaus, 
which  are  Project  Management,  Engineering  Management, 
Construction  Management,  Program  Control  & Support, 
Labor  Relations  & Community  Programs,  and 
Environmental  & Regulatory  Compliance.  To  facilitate  this 
delegation,  the  contract’s  task  orders  are  assigned  to  one 
of  the  eight  service  orders  as  detailed  in  Exhibit  1. 


The  term  of  the  WIP  contract  ended  on  December  31,  2005. 


The  contract  also: 


• Provides  for  fixed  hourly  rates  for  contractor  and 
subcontractor  personnel. 

• Includes  a schedule  of  approved  contractor  staff 
members,  classifications,  and  billing  rates,  and  outlines 
a protocol  for  making  changes. 

• Specifies  criteria  for  billing  of  Other  Direct  Costs 
(ODCs),  including: 

o Categories  that  are  acceptable, 
o That  they  are  to  be  billed  at  actual  cost  with  no 
markup. 

o That  they  are  subject  to  pre-approval  by  the  PUC. 

• Permits  a subcontractor  administration  markup  limited 
to  actual  cost,  not  to  exceed  five  percent. 

During  the  period  covered  by  our  audit,  there  were  32 
Parsons  subcontracts  and  purchase  orders  approved  under 
the  contract,  and  365  Parsons  and  subcontractor  staff 
members  who  billed  hours.  As  of  May  4,  2007,  the  end  of 
our  audit  period,  Parsons  had  invoiced  the  PUC  for  $23.3 
million  (Exhibit  1).  Personnel  or  labor  billings  made  up 
$22.2  million  (95.3  percent)  of  this  amount,  with  the 
remaining  amount  consisting  of  fees  and  ODCs. 


1 1 ,'i  ^ Amounts  Invoiced  as  of  May  4,  2007 

No. 

Service  Order  Description 

Budgeted 

Invoiced 

Balance 

1 

WSIP  Program  Assessment/Support 

$11,488,768 

$6,622,712 

$4,866,056 

2 

Management  & Administration 

3,853,238 

3,214,568 

638,670 

3 

Project  Management  Support 

4,557,474 

2,898,024 

1,659,450 

4 

Program  Controls  & Support 

5,358,205 

3,724,090 

1,634,115 

5 

Project  Controls  & Support 

5,621,601 

2,258,851 

3,362,750 

6 

Engineering  Management  Support 

5,950,351 

3,770,207 

2,180,144 

7 

Construction  Management  Support 

1,051,100 

847,859 

203,241 

8 

Environmental  Management  Support 

114,718 

9,923 

104,795 

Totals: 

$37,995,455 

$23,346,234 

$14,649,221 

Source:  CSA  analysis  of  PUC  budget  reports  and  contractor  invoices. 


3 


A $19  million  amendment  was 
initially  requested,  but  only  $7 
million  was  subsequently 
approved 


As  work  under  the  contract  progressed,  the  PUC  approved 
task  orders  at  a rate  faster  than  originally  planned.  Task 
orders  amounting  to  the  total  contract  amount  of  $38  million 
were  authorized  as  of  August  2007.  PUC  management  then 
drafted  a proposed  spending  plan  for  the  contract  that 
included  total  spending  of  about  $59  million  by  the  end  of 
2009,  an  increase  of  55  percent. 


M Parsons  Spending  Plan  History 

Service  Order  (SO)  Description 

Original  Spending 
Plan,  through 
December  31,  2007 

Revised  Spending 
Plan,  through 
December  31,  2007 

Proposed  Spending 
Plan,  through 
December  31,  2009 

Program  Management  (SO  1 & 2) 

$4,380,370 

$14,458,685 

$18,308,685 

Project  Management  Support  (SO  3) 

4,112,628 

4,759,902 

6,759,902 

Program/Project  Controls  & Support  (SO  4 & 5) 

8,915,691 

10,979,806 

18,279,806 

Engineering  Management  Support  (SO  6) 

2,396,098 

5,602,253 

5,602,253 

Construction  Management  Support  (SO  7) 

504,400 

1,055,430 

8,895,430 

Environmental  Management  Support  (SO  8) 

0 

114,718 

1,114,718 

Totals: 

$20,309,187 

$36,970,794 

$58,960,794 

Source:  PUC’s  Parsons  Contract  Analysis  spreadsheet,  dated  August  22,  2007. 2 


PUC  management  subsequently  submitted  a request  for 
$19  million  in  additional  funding.  This  request  was 
approved  by  the  Commission  in  November  2007,  and 
forwarded  to  the  Board  of  Supervisors  (Board)  for  review 
and  approval.  The  contract  amendment  that  was  approved 
by  the  Board,  however,  included  an  increase  of  only  $7 
million,  for  a total  revised  budget  of  $45  million. 

Commission  meeting  minutes  from  March  2008  reflect  that 
the  Board  returned  the  original  $19  million  request  to  the 
Commission  with  the  indication  that  no  more  than  a $7 
million  increase  would  be  approved.  The  $7  million  increase 
represents  an  18  percent  increase  to  the  initial  contract 
budget  of  $38  million. 

Amendment  Number  2 is  In  November  2008,  at  the  time  we  concluded  our  analysis, 

currently  under  consideration  the  Commission  approved  the  second  amendment  to  the 
contract,  which  would  add  $19  million.  Approval  of  this 
amendment  will  bring  the  total  value  of  the  contract  to  $64 
million.  The  Board’s  consideration  of  the  amendment  was 
scheduled  to  begin  with  review  by  its  Budget  and  Finance 
Committee  on  December  16,  2008. 


2 The  August  22,  2007,  spending  plan  was  an  interim  one  and  has  since  been  superseded. 


4 


Objectives 


Our  audit  objectives  were  to  determine  whether: 


Scope  and  Methodology 


1 . Internal  controls  over  billing  and  payment  of  invoices  are 
sufficient  to  prevent  inappropriate  payments. 

2.  The  contractor  complied  with  the  requirements  of  the 
agreement  when  billing  the  PUC. 

3.  The  contractor  correctly  billed  the  PUC  for  personnel 
costs,  ODCs,  subcontractor  fees,  and  other  costs. 

The  scope  of  this  audit  included  amounts  billed  from 
contract  inception  through  May  4,  2007,  for  the  purposes  of 
detailed  testing  of  costs.  Our  review  of  procedures, 
controls,  and  selected  compliance  issues  encompassed  the 
practices  in  effect  as  of  the  time  of  our  analysis. 

To  conduct  the  audit,  we  reviewed  program  and  financial 
information  obtained  from  a variety  of  sources,  including: 

• City,  Parsons,  and  Parsons’  subcontractor  accounting 
records. 

• Contract  administration  information  and  data  provided 
by  the  manager  and  staff  of  the  PUC’s  Infrastructure 
Budget  and  Administrative  Services  group 
(Infrastructure  Budget),  which  is  responsible  for 
administering  the  contract. 

• Contract  administration  information  and  data  provided 
by  Parsons  staff. 

• Project  management  and  performance  management 
best  practices  from  various  sources,  both  inside  and 
outside  the  City. 

In  addition,  we  interviewed: 

• PUC  management  and  staff,  including  the  managers  of 
the  Engineering  Management,  Project  Management, 
Program  Controls  and  Support,  Construction 
Management,  and  Environmental  Management 
bureaus,  and  the  staff  and  management  of  the 
Consultant  Administration  group. 

• Other  PUC  staff  responsible  for  day-to-day  contract 
administration  and  accounting. 

• Parsons  staff  responsible  for  contract  administration 
and  billing. 


Finally,  we  performed  detailed  analyses  and  testing  and 
conducted  best  practices  research  in  several  areas.  Our 


detailed  work  included  reviews  and  testing  of: 

• The  technical  specifications,  administration,  and  usage 
of  a database  and  other  software  solutions  used  by  the 
PUC  to  monitor  and  control  the  contract. 

• Invoice  submission,  review,  and  approval  procedures. 

• Procedures  used  to  review,  approve,  and  annually 
adjust  contractor  and  subcontractor  billing  rates. 

• All  approved  subcontract  agreements,  to  test  for 
adherence  to  content  requirements  and  approval 
protocols  outlined  in  the  Parsons  contract. 

• Approved  task  orders,  to  test  for  adherence  to  contract 
terms  and  PUC  procedures  for  adding  of  service 
orders,  task  orders,  and  staff. 

• Contract  billings,  including  hours  and  rates  invoiced, 
ODCs,  and  administrative  fees. 

• Monthly  reconciliations  of  contract  costs  and  payments 
to  amounts  recorded  in  the  City’s  Financial  Accounting 
and  Management  Information  System  (FAMIS). 

• Adherence  to  insurance  and  bonding  requirements. 

• Adherence  to  best  practices  in  the  development  and 
implementation  of  performance  measures  and 
performance  evaluations. 

We  issued  an  interim  report  on  November  7,  2007,  at  the 
request  of  PUC  management.  The  interim  report  is  included 
as  Appendix  A to  this  report. 

We  conducted  this  performance  audit  in  accordance  with 
generally  accepted  government  auditing  standards.  Those 
standards  require  that  we  plan  and  perform  the  audit  to 
obtain  sufficient,  appropriate  evidence  to  provide  a 
reasonable  basis  for  our  findings  and  conclusions  based  on 
our  audit  objectives.  We  believe  that  the  evidence  obtained 
provides  a reasonable  basis  for  our  findings  and 
conclusions  based  on  our  audit  objectives.  However,  these 
standards  require  that  we  disclose  that  the  former 
Controller  of  the  City  and  County  of  San  Francisco,  to 
whom  the  audit  organization  reported  during  the  course  of 
most  of  this  audit,  was  appointed  General  Manager  of  the 
PUC  while  the  audit  was  being  completed.  Because  the 
standards  require  that  the  audit  organization  be  free  both  in 
fact  and  in  appearance  from  impairments  to  independence, 
we  are  disclosing  this  relationship  because  it  may  be 
perceived  as  a potential  impairment  to  our  independence. 


CHAPTER  1 - Procedures  and  Controls 


Summary 


Finding  1.1 


The  PUC  has  significantly  improved  WSIP  contract 
administration  processes  since  our  last  program 
management  contract  audit  was  issued  in  January  2006; 
however,  some  additional  improvements  are  needed.  Our 
prior  audit  included  five  recommendations  that  are  directly 
relevant  to  the  current  audit,  and  the  PUC  has  made 
noteworthy  efforts  to  address  four  of  them.  To  increase  the 
level  of  assurance  that  amounts  paid  under  the  $45  million 
Parsons  contract  are  appropriate,  the  PUC  should  continue 
to  improve  its  processes  by  addressing  shortcomings  in  its 
current  procedures  and  controls. 

The  findings  and  recommendations  detailed  in  this  chapter 
address  ways  in  which  the  PUC  should  improve  its 
administration  of  the  Parsons  contract,  and  possibly  other 
contracts  for  which  it  uses  similar  contract  administration 
processes.  However,  it  is  important  to  note  that  our  audit 
disclosed  only  approximately  $20,400  in  incorrect  billings.3 
Although  Chapter  2 recommends  ways  for  the  PUC  to 
control  costs,  amounts  approved  for  payment  by  the  PUC 
were  accurate,  based  on  PUC-approved  hours,  billing  rates, 
and  task  orders. 


The  PUC  has  made  significant  improvements  to 
relevant  contract  administration  policies,  procedures, 
and  systems  since  our  last  program  management 
contract  audit  was  issued  in  January  2006. 

In  January  2006,  we  issued  the  sixth  in  a series  of  audits  of 
the  PUC’s  prior  WSIP  program  management  contract  with 
Water  Infrastructure  Partners  (WIP).  Our  current  audit 
revealed  that  the  PUC  has  made  significant  improvements 
to  its  WSIP  contract  administration  policies,  procedures, 
and  systems  since  the  time  of  our  prior  audit,  including 
developing  and  implementing: 

• A billing  database  (“database”)  for  capturing  contract 
financial  data,  including  budgeted  and  billed  amounts, 
approved  billing  rates,  PUC-approved  personnel  hours, 
and  other  data.  This  has  enabled  the  PUC  to  implement 
automated  invoice  review  processes  that  are  more 


The  PUC  has  since  recouped  most  of  this  amount.  See  the  PUC’s  response  at  Appendix  B for  details. 


thorough  and  timely  than  those  in  place  for  the  WIP 
contract. 

• An  electronic  timekeeping  system  (PC  Time)  for  some 
task  orders  that  permits  online  time  entry  by  Parsons 
employees  and  subcontractors,  and  online  review  and 
approval  of  work  hours  by  Parsons  and  PUC  managers. 

• Standardized,  periodic  management  reports  that  detail 
billed  amounts,  and  track  costs  against  budgeted 
amounts. 

• An  electronic  document  tracking  system  (Workflow)  that, 
among  other  functions,  routes  service  order,  task  order, 
and  subcontract  documents  requiring  approval. 
Sequential  approvals  are  given  and  documented 
electronically  until  all  required  approvals  are  received. 

Many  of  the  changes  made  by  the  PUC  are  directly  relevant 
to  recommendations  made  in  our  January  2006  report. 

That  prior  report  included  nine  recommendations,  five  of 
which  were  relevant  to  the  current  audit.  In  setting  up  its 
processes  for  administering  the  current  contract  with 
Parsons,  the  PUC  made  significant  efforts  to  address  four 
of  the  five  relevant  recommendations  from  our  prior  audit. 
The  improvements  we  found  are  summarized  in  Exhibit  3. 


EXHIBIT  3 

Procedural  and  Control  Improvements  Since  Prior  Audit 

Prior  Audit  Recommendation 

Prior  Finding  vs.  Current  Audit  Finding 

Develop  and  maintain  an  authorized  approver  list 
and  a formal  delegation  of  authority  procedure. 

Current:  Authorized  approvers  list  in  place,  but  no 
accompanying  written  procedures. 

Prior:  No  documentation  of  authorized  approvers 
and  insufficient  documentation  of  procedures. 

Require  the  submission  of  properly  completed 
and  approved  timesheets. 

Current:  All  timesheets  and  electronically 
submitted  time  records  were  properly  submitted 
and  approved. 

Prior:  19%  of  timesheets  had  errors  or  omissions. 

Develop  a system  able  to  track  all  invoices, 
account  for  all  resulting  payments,  summarize 
actual  costs,  and  reconcile  actual  payments  to 
the  City’s  FAMIS  accounting  system. 

Current:  A database  captures  contract  financial 
data,  including  amounts  invoiced  and  paid,  and 
produces  management  reports  summarizing  this 
data  and  tracking  actual  expenditures  against 
budgeted  amounts.  The  PUC  now  reconciles 
contract  payments  to  FAMIS. 

Prior:  Mostly  manual  processes  provided 
inadequate  tracking  and  control  over  amounts 
invoiced  and  paid,  and  reconciliations  to  FAMIS 
were  not  being  performed. 

Ensure  that  the  PUC  approves  subcontractor 
agreements  before  they  are  approved  by  the 
contractor. 

Current:  22%  of  subcontracts  or  purchase  orders 
were  approved  by  the  contractor  before  PUC 
approval,  violating  contract  terms. 

Prior:  43%  of  those  in  sample  were  approved  in 
improper  order. 

Require  detailed  documentation  in  support  of 
annual  billing  rate  increases. 

Current  Contractor  submitted  detailed  analyses 
in  support  of  annual  billing  rate  increases. 

Prior.  Insufficient  support  for  contractor’s 
requested  increases.  No  agreed-upon 
interpretation  of  how  to  implement  the  contract’s 
clause  regarding  allowable  billing  rate  increases. 

Source:  Auditor  analysis  and  prior  CSA  report,  PUBLIC  UTILITIES  COMMISSION:  The  Sixth  Review  of  Its  Professional 
Sen/ices  Agreement  for  Management  Services  of  Its  Capital  Improvement  Program,  dated  January  12,  2006. 


Recommendation  1.  To  accompany  its  authorized  approver  list,  the  PUC 

should  develop  and  maintain  formal  delegation  of 
authority  procedures,  as  part  of  a set  of  formal,  written 
procedures  governing  administration  of  the  Parsons 
contract.  (Additional  procedures  for  the  set  are 
recommended  in  later  sections  of  this  report.) 


Finding  1.2 


The  billing  database: 
what  it  is  and  what  it 
does 


The  database  contains 
detailed  billing  data  and 
produces  reports  that  provide 
key  information  to  managers 


To  ensure  its  billing  database  is  reliable  and  effective 
for  monitoring  contract  costs  and  ensuring  that 
invoiced  amounts  are  proper,  the  PUC  should  fully 
document  database  structure  and  appropriate  usage. 

The  PUC  developed  the  billing  database  to  capture  contract 
financial  data  and  to  produce  management  reports, 
including  reports  tracking  actual  expenditures  against 
budgeted  amounts.  The  database  generally  meets  these 
needs,  thereby  facilitating  more  effective  and  timely  review 
of  contract  billings.  The  primary  architect  of  the  database 
was  a Parsons  subcontractor  staff  member,  who  was 
assisted  during  development  and  implementation  by 
Infrastructure  Budget  staff. 

The  database  includes  a collection  of  tables  containing 
contract  data,  including: 

• The  name,  firm,  and  billing  rate  for  all  Parsons  and 
subcontractor  staff  approved  to  bill  time  to  the  contract. 

• Approved  budget,  staff,  and  related  purchase  order  (PO) 
information  for  each  service  order  and  task  order. 

• Cutoff  dates  to  facilitate  reporting,  such  as  contract  year 
and  invoice  period  beginning  and  end  dates. 

• Hours  billed  by  contractor  and  subcontractor  staff, 
identified  by  task  order  and  invoice  period. 

The  database  produces  two  primary  management  tools  that 
support  effective  administration  of  the  contract: 

1 . Pro  forma  invoice:  For  each  invoice  period,  approved 
contractor  hours  and  other  cost  data  are  uploaded  to 
the  database.  Consultant  Administration  staff  then 
generate  a report  from  the  database,  which  it  refers  to 
as  a “pro  forma”  invoice,  that  includes  all  hours 
approved  for  billing  and  associated  cost  data.  This  pro 
forma  invoice  is  reviewed  against  the  actual  invoice 
submitted  by  the  contractor,  and  any  discrepancies  are 
reconciled  before  the  invoice  is  approved  for  payment. 

2.  Management  reports:  Consultant  Administration  staff 
produce  budget  status  reports  generated  from  the 
database,  including  separate  reports  broken  down  by 
service  order,  purchase  order,  and  project.  These 
reports  show  approved  budgets,  spent-to-date  amounts, 
and  remaining  budget  figures,  and  include  both  detailed 
and  summary  information.  The  reports  are  distributed  to 
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service  and  task  order  managers,  as  well  as  other 
management  and  staff,  to  assist  in  monitoring  contract 
costs  and  managing  the  contractor’s  work. 

Database  weaknesses  We  found  that  the  database  does  a reasonably  effective  job 

should  be  addressed  of  accomplishing  the  tasks  for  which  it  was  designed. 

However,  several  weaknesses  should  be  addressed  to 
improve  the  security,  integrity,  and  usefulness  of  the 
database. 

We  identified  the  following  problems  with  the  database: 

1 . The  database  is  not  sufficiently  documented:  Because 
the  PUC  relies  heavily  on  the  database,  it  is  essential 
that  it  be  well  documented.  However,  no  written 
procedures  exist  to  describe  how  the  database  was 
built,  what  steps  are  required  to  maintain  it,  and  how  to 
use  it  properly.  Without  clear  documentation  regarding 
the  structure,  contents,  and  usage  of  the  database, 
current  and  future  users  may  encounter  difficulty  in 
using  it,  and  data  integrity  may  be  compromised.  This 
may  lead  to  an  inability  to  adequately  verify  invoices, 
monitor  contract  costs,  and  produce  management 
reports. 

2.  PUC  vs.  contractor  duties  are  not  well  documented: 
There  are  no  written  procedures  covering  database 
access  privileges  and  supervision  of  contractor  and 
subcontractor  database  work.  A Parsons  subcontractor 
staff  member  had  a primary  role  in  designing  the 
database,  and  has  a primary  role  in  ongoing  database 
maintenance.  Although  a PUC  Consultant 
Administration  staff  member  has  a supporting  role,  and 
also  has  some  administrative  duties  and  access  to  the 
database,  the  primary  database  architect’s  status  as  a 
subconsultant  under  the  Parsons  contract  creates  an 
apparent  conflict  of  interest.  Under  the  current  protocol, 
Parsons  billing  rates  could  be  adjusted  without 
approval,  and  the  PUC  would  not  necessarily  notice  the 
change.  The  security  and  integrity  of  the  database 
would  be  improved  by  written  procedures  that  define 
access  privileges,  outline  the  limits  of  the  consultant's 
authority,  and  otherwise  provide  for  the  supervision  of 
contractor  and  subcontractor  staff  working  with  the 
database. 
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Recommendation 


Finding  1.3 


Timekeeping  system 
should  be  modified 


3.  Database  administration  is  inconsistent  and  not  well 
documented:  Several  periodic  duties  related  to 
uploading  data  into  the  database  were  not  performed 
using  consistent  procedures,  and  actions  taken  were 
not  always  well  documented. 

• Source  files  uploaded  into  the  database  were  not 
always  properly  archived,  and  documentation  was 
not  always  created  to  show  the  upload  date  and 
who  processed  the  upload. 

• Billed  hours  data  in  the  database  is  not  consistent. 
Some  records  included  entries  as  daily  hours,  while 
others  were  weekly  or  monthly  summaries  of  time. 


2.  The  PUC  should  develop  and  implement  written 
procedures  and  guidelines  for  the  database  that: 

• Fully  document  the  technical  specifications  of  the 
database. 

• Specifically  outline  the  duties  and  authorities  of 
PUC  and  Parsons  staff  and  subcontractors  who 
work  with  the  database,  including  defining  the 
limitations  of  authority  for  the  database 
administrator,  who  is  a Parsons  subcontractor. 

• Outline  requirements  for  the  proper  uploading  of 
data,  including  documentation  required  to  establish 
a proper  audit  trail. 

• Require  that  critical  information  input  into  the 
database,  and  any  changes  made  to  the  database 
structure  or  functionality,  be  reviewed  and 
approved  by  the  PUC. 


The  PUC  should  streamline  and  improve  its 
timekeeping  system  for  the  contract  to  minimize  the 
time  required  for  PUC  and  contractor  staff  to  submit 
and  approve  time,  and  to  reduce  the  potential  for 
approval  of  inappropriate  payments  to  the  contractor. 

The  PUC  does  not  use  one,  consistent  system  for  tracking 
the  submission  and  approval  of  hours  billed  under  the 
contract.  Two  service  orders  use  an  electronic  timekeeping 
system  (PC  Time),  while  the  remaining  service  orders  use  a 
primarily  manual  system,  which  is  a combination  of 
individual  hard  copy  timesheets  and  timesheet  summary 
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spreadsheets  for  each  service  order. 


[Recommended  Timekeeping  and  Database  Improvements 

V Fully  document  technical  specifications  of  the  database 

V Clearly  document  duties  and  limits  of  authority  of  contracted  database  administrator 

V Consider  implementing  a unified  time  approval  protocol  for  all  service  orders,  either  all 
electronic  or  all  manual 


V Have  PUC  managers  review  and  approve  daily  time  detail  for  contractor  staff  on  a weekly 
basis,  rather  than  only  weekly  time  summaries 

V Create  written  policies  and  procedures  to  guide  the  review  and  approval  of  contractor 
staff  time,  and  to  govern  and  guide  the  use  of  the  database 


Source:  Auditor  analysis  of  PUC-Parsons  timekeeping  procedures. 


These  two  systems  function  as  follows. 

1 . PC  Time  (service  orders  SOs  1 & 4): 

• Contractor  and  subcontractor  staff  enter  their  hours 
into  PC  Time  via  a web  interface. 

• PUC  task  order  and  service  order  managers  review 
and  approve  time  electronically. 

• Approved  hours  are  periodically  uploaded  to  the 
billing  database. 

2.  Manual  timekeeping  (service  orders  SOs  2,  3 & 5-8): 

• Contractor  and  subcontractor  staff  enter  hours  in  a 
weekly,  Excel-based  timesheet. 

• Parsons  contract  management  staff  generate  a 
summary  spreadsheet  for  each  service  order,  for 
each  week,  which  includes  all  billed  hours  for  which 
approval  is  sought. 

• Parsons  submits  a hard  copy  and  electronic  copy  of 
the  summary  spreadsheets. 

• Copies  of  all  individual  timesheets  that  support  a 
given  timesheet  summary  spreadsheet  are 
submitted  with  the  summary.  If  an  individual  worked 
on  multiple  service  orders  during  a given  time 
period,  this  process  requires  that  a copy  of  his  or 
her  timesheet  be  made  for  each  service  order. 

• The  weekly  timesheet  summaries  for  each  service 
order  are  circulated  to  the  service  order  and  task 
order  managers  for  review  and  signature. 

• PUC  Consultant  Administration  keeps  the  individual 
timesheet  copies  for  reference,  but  does  not 
routinely  circulate  them  to  task  order  managers  for 
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review. 

• After  the  timesheet  summaries  are  approved,  the 
hours  from  the  electronic  versions  of  the  timesheet 
summaries  are  uploaded  to  the  database. 


The  PUC  declined  to  incur  the 
cost  to  implement  PC  Time  on 
all  service  orders 


PUC  staff  informed  us  that  PC  Time  implementation  was 
originally  planned  for  all  service  orders,  but  implemented 
only  on  two  of  eight  service  orders  because  of  software  and 
other  compatibility  problems  among  PC  Time,  FAMIS,  and 
the  P3E  module  of  the  PUC’s  Primavera  project 
management  software.  PUC  management  decided  that  the 
costs  required  to  make  PC  Time  compatible  with  the 
timekeeping  needs  of  all  service  orders  were  not  worth  the 
benefits  that  would  result. 


The  use  of  two  parallel,  disparate  timekeeping  systems  on 
the  contract  resulted  in  three  main  problems: 

1 . Extra  work  is  required  of  PUC  and  contractor  staff 
(billed  to  the  contract)  because  these  two  parallel 
timekeeping  systems  are  in  place,  rather  than  one 
unified  system.  Use  of  any  unified  system,  either  paper- 
based  or  electronic,  would  likely  be  more  efficient  and 
less  expensive. 

2.  No  summary  of  all  time  on  all  service  orders,  broken 
down  by  person,  is  distributed  for  review  and  approval 
by  service  order  managers.  Therefore,  if  a person  works 
hours  on  both  a PC  Time  service  order  and  a hard- 
copy-timesheet service  order  in  the  same  time  period, 
no  one  is  reviewing  and  approving  the  person’s  total 
hours.  In  this  scenario,  unauthorized  overtime  or  other 
unacceptable  practices  could  easily  be  missed. 

3.  For  six  of  eight  service  orders,  PUC  task  order 
managers  review  and  approve  only  weekly  summaries 
of  time  billed  by  contractor  and  subcontractor  staff.  To 
ensure  that  staff  time  is  accurately  recorded  and 
adequately  reviewed,  PUC  managers  should,  on  a 
weekly  basis,  review  and  approve  daily  time  detail. 

Furthermore,  there  are  no  written  procedures  describing 
how  the  timekeeping  systems  work  and  outlining  the 
responsibilities  and  authorities  of  PUC  and  Parsons 
personnel  who  are  part  of  the  process. 
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Recommendations 


Finding  1.4 


3.  Move  to  a single,  unified  timekeeping  system  for  the 
contract.  If  the  PUC  does  not  want  to  incur  the  costs 
required  to  develop  and  implement  electronic 
timekeeping  across  all  service  orders,  it  should 
consider  reverting  to  the  paper-based  system  for  all 
service  orders. 

4.  For  the  service  orders  using  paper-based  timekeeping, 
route  the  individual  timesheets,  rather  than  only  weekly 
timesheet  summaries,  for  review  and  approval  by  all 
required  PUC  task  order  and  service  order  managers. 

5.  Develop  and  publish  written  procedures  that  describe 
the  timekeeping  system  and  detail  the  responsibilities 
of  PUC  and  contractor  personnel. 


Minor  improvements  to  subcontracting  procedures  are 
required. 

Minor  improvements  to  subcontracting  procedures  and 
controls  are  needed  to  ensure  that  code  compliance  is 
adequately  documented  and  proper  approval  and  billing 
practices  are  followed. 

Our  review  of  all  32  approved  subcontracts  and  purchase 
orders  showed  that  subcontracting  generally  complied  with 
contract  and  other  requirements,  but  the  following  issues 
should  be  addressed: 

• Ten  subcontracts  were  entered  into  with  a “PUC- 
directed  source,”  without  a competitive  solicitation. 
Billings  for  these  subcontracts  amounted  to  $497,455 
during  the  audit  period.  Services  provided  included 
program  planning,  engineering  services,  training 
services,  and  retreat  facilitation.  The  PUC  provided  no 
documentation  of  its  reasoning  for  not  conducting 
competitive  solicitations,  while  Parsons  said  it  does  not 
conduct  competitive  solicitations  when  it  is  directed  to  a 
source  by  a client.  In  addition  to  helping  ensure 
reasonable  pricing,  competitive  processes  for 
subcontracting  would  help  avoid  the  appearance  that 
the  contract  was  being  used  to  circumvent  the  City’s 
procurement  rules. 
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• Parsons  approved  7 of  32  subcontracts  and  purchase 
orders  before  PUC  approval,  in  violation  of  contract 
terms.4 

• Three  agreements  for  professional  services  were 
completed  using  a purchase  order  (PO)  rather  than  a 
subcontract,  which  should  be  the  default  format  for 
services.  Using  a subcontract  provides  greater 
protection  to  the  City  by  requiring  the  subcontracted 
service  provider  to  adhere  to  the  detailed  liability 
insurance  and  indemnification  clauses  included  in  the 
City’s  prime  contract  with  Parsons. 

• Billings  under  four  agreements  for  services  were  billed 
as  ODCs,  rather  than  as  separate  labor  hours  and 
expenses. 


Recommendations  6.  The  PUC  and  Parsons  should  document  the 

justification  for  all  subcontracts  procured  without 
soliciting  multiple  proposals. 

7.  Future  subcontract  agreements  for  the  provision  of 
professional  services  should  be  completed  using  a 
subcontract  rather  than  a PO. 

8.  Future  subcontract  agreements  that  involve  the 
provision  of  services  should  be  billed  as  separate  labor 
hours  and  expenses,  rather  than  billed  in  lump  sum  as 
ODCs. 


Finding  1.5  The  process  for  reconciling  contract  payments  to 

amounts  recorded  in  FAMIS  should  be  streamlined  and 
more  thoroughly  documented. 

Overall,  the  PUC’s  process  for  reconciling  contract 
payments  to  FAMIS  is  sufficient.  However: 

• Reconciliations  are  done  manually,  taking  one  person 
two  days  per  month  to  complete.  A streamlined,  semi- 
automated  process  may  be  available  through  the 
Controller’s  accounting  systems  group. 

• Reconciliations  are  not  adequately  documented, 
because  they  are  not  signed  and  dated  by  staff  who 


4 This  should  be  effectively  addressed  by  the  continued  use  of  the  Workflow  approval  tracking  system  instituted 
for  subcontracts  in  early  2007. 
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prepare  and  approve  them. 


Recommendations 


Finding  1.6 


9.  Work  with  the  Controller’s  accounting  systems  staff  to 
streamline  the  process  of  reconciling  contract 
payments  to  FAMIS,  if  feasible. 

10.  Properly  document  reconciliations  to  FAMIS  by  having 
staff  sign  and  date  their  preparation,  review,  and 
approval. 


A contract  amendment  is  warranted  to  clarify  errors 
and  provide  a more  thorough  definition  of  certain 
contract  requirements. 

Three  changes  are  necessary  to  fix  contract  problems  and 
clarify  an  unclear  procedure: 

• The  City’s  standard  audit  clause  was  altered  in  this 
agreement  without  sufficient  justification.  The  standard 
audit  clause  grants  the  City  access  to  all  invoices, 
materials,  payrolls,  records  or  personnel  and  other  data 
related  to  all  other  matters  by  this  Agreement.  The 
PUC’s  contract  with  Parsons  includes  the  limitation, 
except  that  the  Contractor's  billing  rates  are  not  subject 
to  audit  with  respect  to  the  makeup  or  composition  of 
the  rates.  The  standard  audit  clause  should  be  adopted 
to  prevent  potential  limitations  on  future  audits. 

• The  compensation  section  should  be  amended  to 
reflect  that  payments  will  be  made  within  30  days  of  the 
end  of  the  invoice  period.  As  it  is  written,  it  implies 
payment  in  one  day. 

• The  contract  is  unclear  regarding  the  appropriate  time 
period  to  reference  when  setting  the  allowable  annual 
Consumer  Price  Index  (CPI)  increase  to  billing  rates. 
For  a CPI  adjustment  effective  August  1,  2006,  the 
PUC  and  Parsons  agreed  to  apply  an  increase  based 
on  the  2005  calendar  year.  However,  a reasonable 
alternative,  based  on  the  contract  language,  would 
have  been  based  on  the  twelve-month  period  of  August 
2005  through  July  2006. 
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Recommendation 


1 1 . Amend  the  contract  to: 


• Eliminate  the  limitation  in  the  audit  clause. 

• Address  the  error  regarding  payment  timing  in  the 
compensation  section. 

• Clarify  the  precise  time  period  to  reference  when 
setting  the  allowable  annual  CPI  increase  to  be  used 
in  the  annual  billing  rate  adjustment  process. 
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CHAPTER  2 - Contract  Cost  Control 


Summary 


Finding  2.1 


Although  the  PUC  has  made  significant  improvements  to  its 
contract  administration  processes,  additional  efforts  are 
needed  to  control  costs  and  ensure  that  billed  amounts  are 
appropriate. 

The  PUC  should: 

• Better  define  the  task  orders  billed  to  by  Parsons 
contract  management  and  administration  staff,  by 
including  deliverables,  performance  measures  and/or 
detailed  subtask  schemes,  to  make  these  task  orders 
clear  and  fully  compliant  with  contract  requirements. 

• Adhere  to  contract  terms  regarding  allowable  markups 
on  ODCs  and  subcontractor  billings. 

• Increase  scrutiny  of  contractor  billing  rate  requests  and 
annual  billing  rate  increases. 

• Ensure  ODCs  are  properly  approved  and  consistent 
with  contract  terms. 


To  better  substantiate  the  appropriateness  of  hours 
billed  by  Parsons  contract  management  and 
administration  staff,  the  PUC  should  more  tightly  define 
the  scope  of  work,  and  more  closely  monitor  contractor 
performance,  on  administrative-oriented  task  orders. 

Our  analysis  identified  four  task  orders,  with  total  billings 
during  the  audit  period  of  $3.3  million,  that  consisted 
primarily  (not  exclusively)  of  management  and 
administrative  tasks.  The  contract  states  that,  “clerical  and 
administrative  costs  shall  be  included  as  part  of  the 
overhead  rate.  Billable  hours  shall  be  invoiced  only  for 
those  individuals  listed  in  a specific  task  order.”5  The  PUC 
has  authorized  substantial  direct  billing  of  time  by  contractor 
staff  whose  duties  are  primarily  managerial  and 
administrative.  This  staff  includes  a Contracts  and  Business 
Manager,  a Project  Controls  Manager,  and  a Principal 
Accountant. 


5 The  contract  with  Parsons  is  a labor-hour  contract,  under  which  fixed  billing  rates  for  technical  staff  include  a 
markup  to  compensate  the  contractor  for  indirect  or  overhead  costs,  including  clerical,  administrative,  and 
management  support.  The  markup  also  provides  for  a reasonable  level  of  profit. 
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EXHIBIT  5 

1 Billings  Under  Management  & Administration  Task  Orders,  through 
| May  4,  2007 

Task  Order  # 

Description 

Billed  Hour  $ 

1.07 

Management  & Administration 

$ 536,471 

1.08 

Contract  Management/Administration 

1,320,316 

2.01 

Management  & Administration 

446,504 

2.02 

Contract  Management/Administration 

1,037,042 

Total: 

$ 3,340,333 

Source:  Auditor  analysis  of  PUC  database  records. 


PUC  Consultant  Administration  personnel  cited  business 
needs  and  other  justification  for  these  costs,  including 
significant  administrative  requirements  placed  on  the 
contractor.  However,  we  found  that  the  work  under  these 
“level-of-effort”  task  orders  is  not  defined  well  enough  to 
ensure  that  costs  are  controlled  and  billed  amounts  are 
appropriate,  or  to  facilitate  objective  evaluation  of  the 
contractor’s  performance.  (See  Finding  3.1  for  a detailed 
discussion  of  level-of-effort  task  orders.) 

The  task  orders  lack: 

• Specific-enough  deliverables. 

• The  well-developed  performance  measures  that  would 
be  needed  to  effectively  manage  them  as  “level-of- 
effort”  task  orders.6 

Because  they  are  inadequately  defined,  evaluation  of  the 
contractor’s  work  under  these  four  task  orders  is  almost 
entirely  qualitative,  and  therefore  overly  subjective.  Better 
monitoring  and  cost  control  would  be  achieved  either  by 
implementing  effective  performance  measures  or  by  more 
precisely  monitoring  these  task  orders  by  implementing 
clearly  defined  subtask  schemes  to  categorize  the  work 
within  the  general  task.  The  fact  that  the  high  number  of 
hours  billed  directly  by  administrative  staff  could  reasonably 
be  questioned  warrants  the  most  specific  definition  possible 
of  the  scope  of  work  of  these  task  orders.  (See  Chapter  3 
for  a detailed  discussion  of  the  management  of  the 
contractor’s  performance.) 


6 The  PUC  categorized  as  “level-of-effort”  task  orders  those  that  do  not  have  specific  work  product  requirements 
(deliverables)  due  on  specific  dates,  e.g.  a report  due  on  a certain  date.  Without  defined  deliverables  to  review 
and  evaluate,  effectively  managing  a contractor’s  work  can  be  done  by  including  negotiated  outcome  goals 
(performance  measures)  into  the  agreement. 
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Recommendation 


Finding  2.2 


12.  Implement  effective  performance  measures  or  describe 
the  work  with  well-defined  deliverables  at  the  subtask 
level. 


The  PUC  made  incorrect  payments  to  the  contractor, 
because  it  improperly  administered  contract  markup 
provisions. 

Two  markup  provisions  in  the  contract  were  improperly 
administered: 

1.  The  PUC  paid  Parsons  $16,333  in  administrative 
markup  on  ODCs  for  the  audit  period.  However,  the 
contract  states  that  all  ODCs  will  be  reimbursed  at 
actual  cost,  and  that  no  markup  shall  be  included. 

PUC  personnel  confirmed  that  they  allowed  Parsons  to 
charge  a five  percent  fee  on  ODCs  incurred  and  billed 
by  subcontractors  because  of  Parsons’  concerns  about 
the  administrative  cost  of  processing  ODC  paperwork 
for  subcontractors.  However,  the  PUC  should  not  permit 
Parsons  to  bill  amounts  that  are  inconsistent  with 
contract  terms. 

2.  The  PUC  did  not  require  Parsons  to  justify  applying  the 
contract  maximum  of  a five  percent  markup  on 
subcontractor  labor  for  subcontractor  administration. 
The  contract  states  that  subcontractor  administration 
markup  is  permissible  at  actual  cost,  up  to  a maximum 
of  five  percent.  However,  the  PUC  permitted  Parsons  to 
bill  the  maximum  of  five  percent  without  substantiating 
its  actual  cost.  The  value  of  each  percentage  point  of 
the  markup  through  the  end  of  the  audit  period  was 
$139,334  (Exhibit  6). 
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| Subcontract  Administration  Markup  Billed,  through  May  4,  2007 


Subcontractor  Labor  Billed 


Markup  Billed 
(5%  of  labor  total) 


Value  of  Each  1%  of  Markup 
(1/5  of  Total  Markup) 


$13,933,430 

Source:  Auditor  analysis  of  contractor  invoices. 


$696,672 


$139,334 


As  discussed  in  the  previous  finding,  contractor 
management  and  administrative  personnel  have  billed 
substantial  amounts  of  time  directly  to  the  contract.  This 
makes  it  more  likely  that  Parsons’  actual  additional 
administrative  burden  for  subcontractor  administration  is 
less  than  five  percent. 


Recommendations  13.  Recoup  $16,333  from  Parsons  for  amounts  paid  for 

administrative  markup  on  ODCs  for  the  audit  period, 
along  with  any  such  amounts  billed  and  paid 
subsequent  to  the  end  of  the  audit  period. 

14.  Require  Parsons  to  justify  the  five  percent  markup  for 
subcontractor  administration  by  substantiating  its  actual 
additional  costs.  Recoup  any  amounts  paid  to  date  that 
exceed  Parsons’  actual  costs. 


Finding  2.3  To  help  control  costs,  the  PUC  should  more  closely 

scrutinize  billing  rates  above  the  contract  maximum. 


Costs  for  use  of  the  most 
expensive  contractor 
staff  increased  by  59 
percent  from  contract 
year  one  to  year  two 


• From  contract  year  one  to  contract  year  two,  the 
percentage  of  total  billed  labor  costs  made  up  of  hours 
billed  at  or  above  the  maximum  increased  from  8.3  to 
13.2  percent,  an  increase  of  59  percent  (Exhibit  7). 

• Detailed  testing  showed  that  the  PUC’s  approval  of 
these  billing  rates,  and  all  billing  rates  generally,  was 
consistent  with  contract  terms. 


The  contract  states  that  maximum  “hourly  compensation 
shall  not  exceed  $180... unless  otherwise  approved  by  the 
Deputy  General  Manager.”  Because  the  PUC  did  not 
calculate  and  document  an  adjusted  maximum  rate  for  year 
two  of  the  contract,  we  used  the  CPI  adjustment  agreed  to 
by  the  PUC  and  Parsons  for  year  two  of  the  contract,  and 
we  calculated  the  year  two  rate  to  be  $183.78.  We  found 
that: 
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The  PUC  did  not  document  its  justification  for  approving 
billing  rates  above  the  contract  maximum. 


Source:  CSA  analysis  of  PUC  billing  database. 

Recommendations  15.  More  closely  scrutinize  proposed  billing  rates  above  the 

contract  maximum,  and  document  the  justification  for 
approving  the  rates. 

16.  Calculate  and  document  an  adjusted  maximum  billing 
rate  for  contract  year  three  and  subsequent  contract 
years. 


Finding  2.4  The  PUC's  review  of  the  contractor’s  proposed  billing 

rate  increases  did  not  completely  ensure  compliance 
with  contract  terms. 

The  contract  permits  the  contractor  and  subcontractors  to 
request  annual  billing  rate  increases  for  their  staff  working 
on  the  contract.  The  contract  states  that  billing  rates  “can  be 
adjusted  annually.  The  amount  of  the  adjustment  will  be 
limited  to  a maximum  of  the  CPI  (San  Francisco  Bay  Area 
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for  Urban  Wage  Earners  and  Clerical  Workers)  for  the 
previous  year.”  We  found  that  the  PUC’s  process  for 
administering  billing  rate  adjustments  was  not  always 
effective,  partially  because  of  ambiguous  contract  language, 
and  partially  because  of  insufficient  procedures. 

The  contract  permits  two  The  contract  allows  annual  billing  rate  adjustments  to  be 
different  methods  for  allotted  among  the  staff  of  each  firm  in  one  of  two  ways, 

applying  annual  billing  The  contract  states  that  “adjustments  for  individual 

rate  adjustments  Contractor  employees  may  exceed  the  maximum  provided 

that  the  total  adjustment  dollars  for  Contractor  employees 
dedicated  to  this  contract  does  not  exceed  the  maximum 
dollars  based  on  the  billing  rate  on  the  contract  for  the 
previous  year  plus  the  CPI."  The  PUC  implemented  this  by 
allowing  Parsons  and  subcontractors  to  adjust  billing  rates 
in  one  of  two  ways. 

1 . Uniform:  The  agreed-upon  consumer  price  index  (CPI) 
increase  may  be  applied  across  the  board  to  all  staff 
members. 

2.  Average:  The  contractor  or  subcontractor  may  calculate 
the  total  dollars  that  an  across-the-board  increase 
would  amount  to,  then  distribute  increases 
disproportionately  (e.g.,  billing  rates  for  some  staff  could 
increase  more  than  the  CPI,  with  other  rates  increasing 
less  than  the  CPI).  Firms  using  this  approach  submitted 
analyses  intended  to  substantiate  that  their  requested 
increases  were  consistent  with  contract  terms. 

Bill  rate  administration  We  found  the  following  shortcomings  in  the  PUC’s 

procedures  were  not  administration  of  requested  billing  rate  increases: 

sufficiently  developed 

• The  PUC’s  review  of  requested  increases  was  not 
detailed  enough,  because  it  did  not  prevent  the  errors 
and  procedural  issues  discussed  below. 

• As  discussed  in  Chapter  1 , the  contract  specifies  the 
applicable  CPI,  but  does  not  adequately  define  the 
applicable  date  range  to  be  referenced.7 

• Because  billing  rate  adjustment  procedures  were  not 
clearly  defined  by  the  PUC,  firms  did  not  all  use  the 
proper  prior-year  approved  and  billed  hours  and  billing 
rates  as  the  basis  for  the  projections  necessary  to 

7 For  example,  for  increases  to  be  effective  on  August  1 , 2007,  should  the  referenced  date  range  for  the  CPI  be 
the  previous  twelve  months  (August  1 , 2006,  to  July  31 , 2007)  or  the  prior  calendar  year  (January  1 to  December 
31,  2006).  In  this  example,  the  CPI  increases  were  significantly  different;  they  were  3.9  and  2.1  percent, 
respectively. 
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Recommendations 


Finding  2.5 


calculate  proposed  increases.  In  some  cases,  they  used 
the  hours  and  billing  rates  in  their  own  accounting 
systems,  which  did  not  always  match  the  actual  hours 
approved  by  the  PUC  and  the  actual  PUC-approved 
billing  rates. 

• One  subcontractor’s  calculations  differed  significantly 
from  calculations  based  on  approved  hours  and  rates 
per  the  PUC’s  billing  database.  This  was  because  one 
staff  member  was  assigned  to  the  wrong  firm  in  the 
PUC’s  database,  and  the  error  had  not  been  caught. 

• Incorrect  billing  rates  were  used  for  one  subcontractor 
staff  member,  resulting  in  $3,943  in  overcharges  to  the 
contract. 


17.  Develop  and  implement  detailed  procedures  to  govern 
the  administration  of  annual  billing  rate  increases  under 
the  contract.  The  procedures  should: 

• Ensure  that  all  contractors  use  consistent,  contract- 
compliant,  and  agreed-upon  methods  for  preparing 
and  submitting  billing  rate  increase  requests. 

• Provide  a detailed  form  and  instructions  to  Parsons 
to  ensure  compliance  with  these  methods. 

• Include  details  such  as  the  exact  period  for  which 
“base  year”  costs  are  to  be  calculated,  the  correct 
CPI,  and  any  special  circumstances. 

• Require  Parsons  and  subcontractors  to  use  PUC- 
approved  billed  hours  and  billing  rates  for 
calculating  billing  rate  increases. 

• Require  a more  detailed  review  of  billing  rate 
increase  calculations  performed  by  Parsons  and 
subcontractors,  including  reconciling  hours  and 
rates  in  submitted  calculations  to  those  in  the  PUC’s 
billing  database. 

18.  Recoup  $3,943  in  overcharges  caused  by  using 
incorrect  billing  rates  in  calculating  allowable  billing  rate 
adjustments. 


Procedural  improvements  are  needed  to  ensure  ODCs 
are  properly  approved  and  consistent  with  contract 
terms. 

Our  review  of  the  $82,241  in  ODC  billings  for  the  month  of 
April  2007  disclosed  only  $535  in  errors,  but  revealed  that 
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Recommendation 


procedures  for  submitting  and  approving  these  costs 
require  improvement.  ODCs  accounted  for  2.1  percent  of 
total  billings  during  the  audit  period  ($499,330  out  of  $23.3 
million). 

We  found  that: 

• 34  percent  (15  of  44)  of  cost  items  reviewed  were  not 
sufficiently  documented.  They  lacked  one  or  more  of  the 
following:  expense  report,  receipt,  third-party  invoice,  or 
similar  documentation. 

• 72  percent  (1 8 of  25)  of  expense  reports  for  staff  travel 
and  relocation  expenses  were  not  signed  by  the 
submitter  of  the  expense  report  and/or  an  appropriate 
supervisor.  These  signoffs  are  important  because  they 
constitute  certification  that  the  expenses  were  proper 
and  appropriately  charged  to  the  contract. 

• 63  percent  (1 2 of  1 9)  of  travel-related  expense  items 
were  either  of  a type  disallowed  by  the  contract  (e.g., 
public  transit  fares,  when  only  out-of-town  travel 
expenses  were  permissible),  or  the  amount  billed  for  the 
item  exceeded  contract  per  diem  rates  (e.g.,  maximum 
allowed  for  lunch  is  $18  per  person). 

• None  of  the  38  subcontractor  invoices  we  reviewed 
were  signed  as  approved  by  a Parsons  manager,  which 
should  be  done  to  certify  their  validity  before  submitting 
them  to  the  PUC  for  approval. 


19.  More  closely  scrutinize  billed  ODCs  to  ensure  that: 

• Expenses  are  properly  documented  with  expense 
reports,  receipts,  third-party  invoices,  and  similar 
documentation. 

• Contractor  and  subcontractor  expense  reports  have 
signature  approval  of  both  the  submitter  and  an 
appropriate  supervisor  before  PUC  approval  of  the 
costs. 

• Travel  expenses  are  billed  at  appropriate  rates  outlined 
in  the  contract. 

• Subcontractor  invoices  are  signed  as  approved  by  a 
Parsons  manager. 
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CHAPTER  3 - Contractor  Performance  Management 


Summary 


Finding  3.1 


The  PUC’s  processes  for  measuring  and  reporting  the 
contractor’s  performance  do  not  provide  sufficient 
information  to  properly  manage  the  contract  and  assess  the 
contractor’s  contributions  to  the  WSIP.  As  discussed  in 
Chapter  2,  a significant  portion  of  the  approved  contract 
budget  is  included  in  “level-of-effort”  task  orders  that  lack 
specific  deliverables  or  well-developed  performance 
measures  necessary  to  manage  them  effectively.  This  lack 
of  definition  provides  a weak  foundation  for  monitoring  the 
contractor’s  performance. 

The  PUC  does  not  report  regularly  on  contractor  or  WSIP 
performance  under  established  City  processes  for 
performance  reporting.  In  addition,  although  the  PUC 
completed  annual  evaluations  of  the  contractor’s 
performance,  these  evaluations  were  not  sufficiently 
rigorous. 


$21.2  million  (56%)  of  the  $38  million  authorized  during 
the  audit  period  was  for  task  orders  lacking  well- 
defined  scopes  of  work. 

Task  orders  approved  under  the  contract  fall  into  one  of  two 
categories: 

• Level-of-effort 

• Deliverables-based 

Within  the  level-of-effort  category  are  the  management  and 
administrative-oriented  task  orders  discussed  in  Chapter  2 
and  a group  of  task  orders  referred  to  by  the  PUC  as  “staff 
augmentation.”  Staff  augmentation  task  orders  involved  the 
contractor  or  subcontractor(s)  providing  staff  to  work 
alongside  PUC  staff,  in  most  cases  physically  located  in  the 
PUC’s  offices.  PUC  managers  were  responsible  for  the  day- 
to-day  supervision  of  these  staffers. 

Deliverables-based  task  orders  in  the  contract  were  well 
defined,  which  means  they  had  clear  scopes  of  work  and 
detailed  work  product  requirements  (deliverables),  staff 
assignments  and  deadlines.  Level-of-effort  task  orders,  by 
contrast,  tended  to  be  vague,  with  one  or  more  of  the 
aforementioned  elements  either  missing  or  only  minimally 
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outlined. 


We  categorized  all  approved  task  orders  as  either 
deliverables-based  or  level-of-effort  and  summed  each 
category’s  approved  budget.  Exhibit  8 shows  the  results  of 
this  analysis. 


EXHIBIT  8 


Budget  by  Task  Order  Type,  as  of  August  2007 


Deliverables-based 
Task  Orders 
$16.7  million  (44%) 


Level-of- Effort 
Task  Orders 
$21.2  million  (56%) 


Source:  Auditor  analysis  of  sample  of  task  orders  and  PUC  categorization  of  remaining  task  orders. 


We  found  that  approved  level-of-effort  task  orders  lacked 
one  or  more  elements  required  by  the  contract.  The 
contract  states  that  task  orders  shall  “...stipulate  a project 
scope,  sub  tasks,  staffing  plan,  DBE  utilization,  schedule, 
deliverables,  budget,  and  costs  to  complete  the  task.”  Our 
examination  of  19  approved  task  orders,  including  9 
deliverables-based  task  orders  and  10  level-of-effort  task 
orders,  disclosed  that: 

• The  nine  deliverables-based  task  orders  included  all  the 
contract-required  elements  listed  above. 

• The  ten  level-of-effort  task  orders  were  all  inadequately 
defined  based  on  the  the  contract’s  requirements, 
making  it  difficult  for  the  PUC  to  objectively  measure 
and  evaluate  the  contractor’s  performance. 


Recommendation  20.  Develop  detailed  deliverable/subtask  schemes  and/or 

performance  measures  for  all  level-of-effort  task 
orders,  so  that  the  scope  of  work  of  each  task  order  is 
compliant  with  contract  terms  and  sufficiently  defined  to 
support  a substantive  (i.e.,  both  quantitative  and 
qualitative)  evaluation  of  contractor  performance. 


Level-of-effort  task 
orders  did  not  include 
required  contract 
elements 
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Finding  3.2  To  support  a more  meaningful  evaluation  process,  the 

PUC  should  develop  and  report  on  contract-specific 
and  program-wide  performance  measures. 

The  contract  contains  no  performance  measures.  Although 
an  evaluation  process  is  in  place,  without  performance 
measures  it  is  inadequate  for  many  task  orders  (see 
Finding  3.3).  The  lack  of  performance  measures  is  not 
critical  for  deliverables-based  task  orders,  because  their 
clearly  defined  work  products  and  deadlines  provide 
benchmarks  for  evaluating  contractor  performance. 
However,  the  lack  of  performance  measures  for  level-of- 
effort  task  orders  should  be  addressed.  Further,  given  the 
size  and  importance  of  the  contract  with  Parsons,  it  would 
be  prudent  to  implement  and  report  on  other  contract 
performance  measures  that  measure,  for  example,  the 
contractor’s  contributions  to  WSIP  goals.8 

The  PUC  does  not  report  regularly  on  contractor  or  WSIP 
performance  under  established  City  processes  for 
performance  reporting.  Performance  data  is  collected  and 
published  annually  by  the  City  Services  Auditor,  and  the 
Mayor’s  office  coordinates  periodic  performance  reporting 
related  to  established  strategic  initiatives.  Despite  the 
importance  of  the  contract  and  the  WSIP,  the  PUC  does  not 
report  regularly  on  contract  or  program  performance  within 
either  of  these  processes. 


The  PUC  does  not  report 
widely  on  contract  and 
WSIP  performance 
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| Characteristics  of  Successful  Performance  Measures 

V Linkage  (between  performance  goals  and  overall  mission) 

V Clarity 

V Measurable  targets 

V Objectivity 

V Reliability  (of  supporting  data) 
a/  Address  core  activities 

V Address  agencywide  priorities 


Source:  Best  practices  reported  by  the  U.S.  Government  Accountability  Office  (GAO). 


Recommendations  21 . Work  with  the  contractor  to  develop  performance 

measures  for  the  overall  contract,  including 


8 Concern  over  a lack  of  performance  measures  for  the  contract  was  previously  raised  by  the  Budget  Analyst  in  a 
report  issued  in  August  2005. 
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performance  measures  for  level-of-effort  task  orders. 


Finding  3.3 


Manager  criticisms  were 
not  included  in  an  annual 
report  to  the  Board  of 
Supervisors 


Evaluation  forms  and 
procedures  were  not 
sufficiently  developed 


22.  Report  on  contractor  and  WSIP  performance  on  a 
regular  basis  through  the  City  Services  Auditor’s 
performance  measurement  process  and  as  part  of  any 
performance  reporting  coordinated  by  the  Mayor’s 
office. 


To  better  support  that  it  is  getting  good  value  for  its 
money,  the  PUC  should  make  the  contractor  evaluation 
process  more  rigorous. 

To  properly  manage  the  contract  and  assess  the 
contractor’s  performance  and  contributions  to  the  WSIP, 
the  PUC’s  annual  evaluation  of  the  contractor’s  work  should 
be  more  rigorous  and  more  broadly  reported.  The  forms, 
procedures,  and  reporting  for  annual  evaluation  processes 
for  each  of  the  first  two  contract  years  did  not  support  a 
rigorous  process.  Moreover,  the  adopted  evaluation 
framework  did  not  link  contractor  performance  to  overall 
WSIP  performance. 

The  PUC’s  first-year  evaluation  format  included  a 
questionnaire  that  asked  PUC  service  order  managers  to 
evaluate  the  contractor’s  overall  performance,  in  addition  to  # 
its  performance  on  the  specific  task  orders  for  which  the 
managers  were  responsible.  Several  service  order 
managers  submitted  evaluations  that  included  specific, 
well-developed  criticisms  regarding  particular  aspects  of  the 
contractor’s  performance.  However,  when  the  individual 
first-year  evaluations  were  consolidated  into  a summary 
report  for  the  Board,  the  report  included  no  mention  of  the 
concerns  noted  by  the  service  order  managers. 

The  second-year  evaluation  process  used  a form  that 
included  a three-point  rating  scale,  with  a top  rating  of 
“Delivered  as  Agreed.”  This  scale  is  quite  narrow,  and  the 
top  rating  closely  resembles  what  is  the  mid-point  or 
average  rating  in  alternative  rating  scales.  Evaluation 
scales  we  reviewed,  including  that  recommended  by  the 
City’s  Department  of  Human  Resources,  included  a top 
range  of  “exceeds  expectations”  or  similar  language.  Use  of 
such  a broader  scale  would  permit  a more  meaningful 
evaluation  of  the  contractor. 
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Besides  the  limitations  in  the  evaluation  form’s  rating  scale, 
the  form  also  lacked  instructions  or  other  guidance  that 
would  make  it  a more  meaningful  document.  Alternative 
evaluation  forms  we  reviewed  included  these  additional 
elements: 


• Detailed  instructions  to  guide  the  evaluator  in  the 
completion  of  the  form,  such  as  what  supporting  data 
should  be  reviewed  before  completing  the  evaluation. 

• Guidance  regarding  what  level  of  performance  against 
each  criterion  warrants  what  level  of  rating. 

Support  was  inadequate  for  As  discussed  in  Finding  3.1 , more  than  half  the  contractor’s 

evaluations  of  level-of-effort  approved  budget  falls  under  level-of-effort  task  orders, 

task  orders  which  are  inadequately  defined.  Beyond  including  no 

deliverables,  they  also  lack  performance  measures  that 
could  provide  quantitative  data  to  reference  when  reviewing 
the  contractor’s  performance.  Because  of  these  noted 
characteristics,  the  evaluations  of  the  level-of-effort  task 
orders  are  not  supported  by  sufficient  data. 


Recommended  Performance  Measurement  & Evaluation  Process 
Improvements 

V Evaluate  overall  contract  performance,  not  only  task  order  performance 

V Report  on  contractor  and  WSIP  performance  on  a regular  basis 

V Include  managers’  comments  in  annual  evaluations 

V Use  a broader  rating  scale  for  evaluations 

V Include  detailed  guidance  and  instructions  on  evaluation  forms 

Source:  Auditor  analysis  of  PUC  performance  management  and  evaluation  processes. 


EXHIBIT  10 


The  scope  of  inquiry  of 
the  evaluation  process 
should  be  expanded 


Contractor  evaluation  is  not 
linked  to  WSIP  progress 


Although  the  first-year  contract  review  process  included 
opportunities  for  PUC  service  order  managers  to  provide 
commentary  on  the  contractor’s  contributions  at  the  overall 
program  level,  the  service  order  managers  were  not  asked 
for  this  level  of  input  in  the  second-year  process.  The 
insight  of  responsible  managers  into  the  contractor’s  overall 
performance,  above  and  beyond  performance  on  specific 
task  orders,  should  be  included  in  the  evaluation  process. 

In  addition,  our  analysis  revealed  no  apparent  link  between 
the  evaluation  of  the  contractor’s  performance  and  overall 
WSIP  progress.  The  contractor’s  WSIP  role  is  significant 
enough  that  a comprehensive  evaluation  of  its  performance 
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should  include  reference  to  the  progress  of  the  WSIP 
against  its  established  goals. 


Recommendations 


23.  Include  relevant  commentary  by  PUC  service  order 
managers  in  future  evaluation  reports. 

24.  Update  contractor  evaluation  forms  to  incorporate 
guidance  regarding  how  to  complete  the  form  and  what 
constitutes  successful  performance  against  each  of  the 
criteria. 

25.  Expand  the  three-point  rating  scale  used  in  the  second- 
year  evaluation  form  to  at  least  a five-point  scale  with 
“met  expectations”  in  the  middle  and  “consistently 
exceeded  expectations”  at  the  high  end. 

26.  Annually  evaluate  and  report  on  the  contractor’s 
overall,  contract-wide  performance  and  the  contractor’s 
contribution  to  the  overall  WSIP.  This  evaluation  should 
include  input  from  all  service  order  managers  who 
supervise  work  on  contract  tasks. 
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APPENDIX  A:  INTERIM  REPORT 
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Fd  Harrington 
Controller 
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Deputy  Controller 


INTERIM  AUDIT  REPORT 

DATE:  November  7,  2007 

TO:  Harlan  Kelly,  Jr.,  Assistant  General  Manager,  Infrastructure 

Public  Utilities  Commission 

/A  i \.j*43cAi 

FROM:  Harriet  Richardson.  Director  of  Audits,  City  Services  Auditor  Division 

SUBJECT:  Interim  Report  on  the  Audit  of  the  PUC’s  Contract  with  Parsons 
Water  & Infrastructure,  Inc. 


BACKGROUND 

In  May  2005,  the  San  Francisco  Public  Utilities  Commission  (PUC)  entered  a $38  million 
contract  with  Parsons  Water  & Infrastructure,  Inc.  (Parsons),  for  program,  project,  and  pre 
construction  management  services  in  support  of  its  Water  System  Improvement  Program 
(WSIP),  a $4.3  billion  program  to  repair,  replace,  and  seismically  upgrade  the  PUC  water 
system's  pipelines,  tunnels,  reservoirs,  and  dams.  The  contract  has  a five-year  term 
ending  July  25,  2010. 

The  agreement  provides  for  fixed  hourly  rates  for  contractor  and  subcontractor  personnel; 
includes  a schedule  of  approved  contractor  staff  members,  classifications,  and  billing 
rates;  and  outlines  protocols  for  staff  changes,  additions,  and  annual  billing  rate  increases. 
The  agreement  also  stipulates  specific  categories  of  Other  Direct  Costs  (ODCs)  that  are 
acceptable,  states  that  ODCs  are  to  be  billed  at  actual  cost  with  no  markup,  and  specifies 
that  ODCs  are  subject  to  pre  approval  by  the  PUC.  There  is  also  a provision  for  a markup 
on  subcontractor  personnel  billings  limited  to  actual  cost  not  to  exceed  five  percent. 

Work  under  the  agreement  is  authorized  by  individual  task  orders,  each  of  whose  scope, 
sub  tasks,  staffing  plan,  schedule,  deliverables,  budget  and  cost  is  established  separately. 
No  work  may  begin  on  a task  order  without  a discrete  Notice  to  Proceed. 

The  City  Services  Auditor  (CSA)  Division  of  the  Office  of  the  Controller  scheduled  an  audit 
of  the  contract  with  Parsons  after  consultations  earlier  this  year  with  the  Assistant  General 
Manager,  Infrastructure.  In  past  years,  the  Office  of  the  Controller  conducted  six  periodic 
audits  of  the  PUC’s  previous  WSIP  program  management  contract  with  Water 
Infrastructure  Partners  (WIP). 
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We  are  submitting  this  interim  report  at  the  request  of  PUC  management.  We  plan  to 
complete  and  issue  a final  audit  report  by  January  15,  2008. 

AUDIT  SCOPE  & OBJECTIVES 

The  period  from  contract  inception  through  May  4,  2007,  is  our  audit  period  for  the 
purposes  of  detailed  testing  of  costs,  although  our  review  of  procedures  and  controls 
encompasses  practices  currently  in  effect  Our  audit  objectives  are  to  determine  if: 

• Internal  controls  over  billing  and  payment  of  invoices  are  sufficient  to  prevent 
inappropriate  payments. 

• The  contractor  complied  with  the  requirements  of  the  agreement  when  billing  the  PUC. 

• The  contractor  correctly  billed  the  PUC  for  personnel  costs,  ODCs,  subcontractor  fees, 
and  other  costs. 

PRELIMINARY  FINDINGS  & RECOMMENDATIONS 

As  of  May  4,  2007,  the  end  of  our  audit  period,  contract  invoices  and  PUC  reports  indicate 
that  $23.3  million  had  been  invoiced.  Our  work  to  date  has  involved  gaining  an 
understanding  of  reporting  and  other  processes  used  by  the  PUC  to  monitor  contractor 
activities,  contractor  performance,  and  contract  expenditures,  as  well  as  processes  and 
procedures  pertaining  to  cost  tracking,  invoicing  by  the  contractor,  and  PUC  invoice  review 
and  approval.  We  are  currently  completing  our  work  in  these  areas  and  performing 
detailed  audit  tests  and  other  steps  to  assess  the  adequacy  of  controls  and  the 
correctness  of  billed  amounts. 

Although  we  have  not  completed  our  audit  work,  the  results  to-date  indicate  that  the  PUC's 
procedures  have  improved  substantially  over  those  in  effect  for  the  contract  with  Water 
Infrastructure  Partners. 

The  PUC  has  developed  and  implemented: 

• A database  for  capturing  contract  financial  data,  including  budgeted  and  billed 
amounts,  approved  billing  rates,  PUC-approved  personnel  hours,  and  other  data.  This 
has  enabled  the  PUC  to  implement  an  automated  invoice  review  process  that  is  more 
thorough  and  timely  than  the  process  that  was  in  place  for  the  WIP  contract. 

• An  electronic  timekeeping  system  for  some  task  orders  that  permits  online  time  entry 
by  Parsons  employees  and  subcontractors,  and  online  review  and  approval  of  entered 
hours  by  both  Parsons  and  PUC  managers. 

• Standardized,  periodic  management  reports  that  detail  billed  amounts  and  track  costs 
against  budgeted  amounts. 
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We  have  also  identified  the  following  preliminary  findings. 

Shortcomings  in  Contract  Language 

The  City's  standard  audit  clause  was  altered  for  this  agreement.  The  standard  audit  clause 
grants  the  City  access  to  all  invoices,  materials,  payrolls,  records  or  personnel  and  other 
data  related  to  all  other  matters  by  this  Agreement.  The  PUC  contract  with  Parsons 
includes  the  limitation,  except  that  the  Contractor's  billing  rates  are  not  subject  to  audit 
with  respect  to  the  makeup  or  composition  of  the  rates.  It  is  unknown  what  difficulties  this 
audit  clause  limitation  could  pose  for  CSA  or  others  engaged  in  an  audit  of  this  contract. 

In  addition,  the  compensation  section  of  the  agreement  mistakenly  states  that  the  PUC  will 
pay  Parsons  on  the  first  day  of  each  month  for  work  in  the  prior  month,  which  implies  a 
one-day  turnaround.  We  confirmed  with  PUC  personnel  that  this  language  is  erroneous, 
and  that  the  intent  was  to  commit  the  PUC  to  paying  within  one  month. 

Administrative  Markup  Not  Allowed  on  ODC  Billings 

The  PUC  paid  Parsons  $16,333  in  administrative  markup  on  ODCs  for  the  audit  period. 
However,  the  contract  states  that  all  ODCs  will  be  reimbursed  at  actual  cost,  and  that  no 
markup  shall  be  included.  PUC  personnel  confirmed  that  they  allowed  Parsons  to  charge  a 
five  percent  fee  on  ODCs  incurred  and  billed  by  subcontractors  because  of  Parsons' 
concerns  about  the  administrative  cost  of  processing  ODC  paperwork  for  subcontractors. 
However,  the  PUC  should  not  permit  Parsons  to  bill  amounts  that  are  inconsistent  with 
contract  terms. 

Formal  Written  Procedures  Needed  for  Key  Areas 

The  PUC  has  informal  procedures  addressing  the  administration  of  the  contract  with 
Parsons,  but  does  not  have  formal  written  procedures.  Because  the  agreement  is  a 
relatively  complex  multiyear,  $38  million  contract  that  is  critical  to  the  WSIP,  it  should  be 
subject  to  a high  level  of  internal  controls  to  assure  contract  compliance  and  cost 
management.  Format  written  procedures  are  an  essential  element  of  internal  controls,  and 
help  ensure  that  contract  administration  requirements  and  processes  are  clearly 
established  and  communicated  to  all  staff,  that  responsibilities  are  clearly  assigned,  and 
that  employees  receive  adequate  guidance  in  performing  their  duties.  In  addition,  the 
nature  of  this  contract  results  in  Parsons'  staff  working  jointly  and  in  tandem  with  PUC  staff 
on  various  functions  and  tasks,  often  in  key  roles.  This  makes  it  particularly  important  that 
the  authorities  and  responsibilities  of  all  parties  be  dearly  documented  and  communicated 
in  formal  written  procedures. 

Formal  written  procedures  should  address  areas  such  as: 


Delineation  of  the  authorities  and  responsibilities  of  PUC  and  Parsons  staff. 


Interim  Report  on  the  Audit  of  the  PUC’s  Contract  with  Parsons  Water  & Infrastructure,  Inc. 
November  7.  2007 


• Delegation  of  authority  among  PUC  staff  responsible  for  the  contract,  including  those 
related  to  approvals  of  new  task  orders,  staff  additions,  rate  changes,  ODCs,  etc. 

• Contractor  and  subcontractor  timekeeping. 

• Review,  approval,  and  processing  of  contractor  invoices. 

• Archiving  and  reporting  on  contract  costs  via  the  PUC’s  database. 

Improved  Documentation  Required  for  Billing  Database 

Improved  documentation  is  required  on  the  structure  and  usage  of  the  database  used  by 
the  PUC  to  verify  Parsons  invoices  and  monitor  contract  costs.  In  addition,  a 
subconsuitant  under  the  Parsons  contract  has  had  a lead  role  in  developing,  maintaining, 
and  administering  the  database,  including  responsibility  for  manipulating  and  uploading 
key  data,  which  is  an  apparent  conflict  of  interest. 

Because  the  PUC  relies  heavily  on  the  database,  it  is  essential  that  it  be  well  documented 
and  subject  to  adequate  controls.  These  controls  should  include  written  documentation 
concerning  access  privileges  and  supervision  of  contractor  and  subcontractor  staff. 

Recommendations 

The  PUC  should  take  the  following  steps  to  ensure  that  the  contract  is  properly 
administered: 

• Amend  the  contract  to  eliminate  the  limitation  in  the  audit  clause  and  to  address  the 
error  regarding  payment  timing  in  the  compensation  section. 

• Recoup  $16,333  from  Parsons  for  amounts  paid  for  administrative  markup  on  ODCs 
far  the  audit  period,  along  with  any  such  amounts  billed  and  paid  subsequent  to  the 
end  of  the  audit  period.  If  the  PUC  wishes  to  pay  administrative  markup  on  future 
ODCs.  it  should  amend  the  contract  accordingly. 

• Prepare  and  distribute  formal  written  procedures  addressing  delineation  of  the 
authorities  and  responsibilities  of  PUC  and  Parsons  staff;  delegation  of  authority 
among  PUC  staff  responsible  for  the  contract;  contractor  and  subcontractor 
timekeeping;  review,  approval,  and  processing  of  contractor  invoices;  archiving  and 
reporting  on  contract  costs;  and  related  areas. 

• Develop  proper  documentation  for  its  database  and  document  guidelines  for  its  use. 
This  documentation  should  establish  clearly  defined  supervisory  procedures  to  assure 
the  review  of  critical  information  entered  in  the  database  and  changes  to  the  database 
structure  or  functionality  made  by  the  subconsuitant. 


No  responses  to  these  recommendations  are  required  All  recommendations  will  be 
included  in  their  final  form  in  the  full  audit  report. 
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This  audit  is  being  conducted  in  accordance  with  generally  accepted  government  auditing 
standards. 


cc:  Ed  Harrington,  Controller 

Peg  Stevenson,  City  Services  Auditor  Director 
Robert  Tarsia,  Audit  Manager 
Susan  Leal,  PUC  General  Manager 
Tony  Irons,  PUC  Deputy  General  Manager 


Page  intentionally  left  blank. 


APPENDIX  B:  DEPARTMENT  RESPONSE 


» a n Francisco  Public  Utilities  C 

January  7.  2009 


Robert  Tarsia,  Deputy  Audit  Director 

Office  of  the  Controller,  City  Services  Audit  Division 

City  Hall  Room  476 

1 Dr.  Carlton  B.  Goodlett  Place 

San  Francisco,  C A 94102 

Subject:  Responses  to  City  Services  Audit  Division  (CSAD)  Recommendations 
Dear  Mr.  Tarsia, 

1 would  like  to  thank  you  and  your  staff  for  providing  the  draft  report  entitled  ' Public 
Utilities  Commission:  Continue  Improving  Administration  of  the  Parsons  Water 
System  Improvement  Program  Contract.”  For  your  review  and  consideration,  I am 
attaching  a completed  Audit  Recommendation  and  Response  form  containing  our 
responses  to  the  twenty-six  items  provided  by  CSAD 

Your  findings  and  recommendations  will  be  very  useful  to  us  as  we  continue  to 
implement  the  Water  System  Improvement  Program  projects,  many  of  which  are 
entering  the  construction  phase. 

If  you  have  questions  or  need  additional  information,  please  do  not  hesitate  to  contact 
me  at  (415)  554-0740. 


Singly. 

Harlan  L.  Kelly,  Jr. 


c:  F.d  Harrington,  General  Manager 

Todd  Rydstrom,  AGM  Business  Services  and  Chief  Financial  Officer 
Rosiana  Angel,  Budget  and  Finance  Manager.  Infrastructure  Division 
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